AD-A266  972 


EDGEWOOD 
RESEARCH, 
DEVELOPMENT  & 
ENGINEERING 
CENTER 


ERDEC'CR-040  \ 


EVALUATION  OF  ALSYS_037 
Ada  COMPILER 


S 


DT1C 

ELECTE  1 
JUL  1 9 1993  I 


Richard  M.  Plishka 

UNIVERSITY  OF  SCRANTON 
Scranton,  PA  18510 


Agustin  Ifarraguerri 
RESEARCH  AND  TECHNOLOGY  DIRECTORATE 


Approved  for  public  release;  distribution  is  unlimited. 


May  1993 


U.S.  ARMY  II 
CHEMICAL  ^ 
AND  BIOLOGICAL 
DEFENSE  AGENCY 


Aberdeen  Proving  Ground.  Maryland  21010-5423 


93-16159 


Disclaimer 


The  findings  in  this  report  are  not  to  be  construed  as  an  official  Department  of  the  Army  position 
unless  so  designated  by  other  authorizing  documents. 


REPORT  DOCUMENTATION  PAGE 

Form  Approved 

OMB  No  0704  0188 

Public  reporting  burden  for  thh  collection  of  information  n  estimated  to  average  l  bout  per  response.  including  the  time  for  reviewing  Instructions,  searching  existing  data  sources, 
gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  Information.  Vend  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this 
collection  of  Information,  including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services.  Directorate  tor  Information  Operations  and  fteports.  12  »5  Jefferson 
Oavh  Highway.  Suite  1204.  Arlington.  V A  22202^4302.  and  to  the  Offke  of  Management  and  Budget.  Paperwork  Reduction  Project  (07Q4-01S8),  Washington,  DC  20503 

1.  AGENCY  USE  ONLY  (Leave  blank )  2.  REPORT  DATE  3.  REPORT  TYPE  AND  OATES  COVERED 

1993  May  Final,  92  Jun  -  92  Aug 

4.  TITLE  AND  SUBTITLE 

Evaluation  of  AIsys_037  Ada  Compiler 

S.  FUNDING  NUMBERS 

C-DAAL03-9  l-C-0034 
D.O.-251 

6.  AUTHOR(S) 

Plishka,  Richard  M.  (University  of  Scranton),  and 

Ifarraguerri,  Agustin  (ERDEC) 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  AOORESS(ES) 

DIR,  ERDEC,*  ATTN:  SCBRD-RTM,  APG,  MD  21010-5423 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

ERDEC-CR-040 

9.  SPONSORING /MONITORING  AGENCY  NAME(S)  AND  AOORESS(ES) 

DIR,  ARO,  P.O.  Box  12211,  Research  Triangle  Park,  NC  27709 

10.  SPONSORING  /MONITORING 

AGENCY  REPORT  NUMBER 

11.  SUPPLEMENTARY  NOTES 

COR:  Dr.  E.  Sarver,  SCBRD-RTE,  (410)  671-5528 

POC:  Augustin  Ifarraguerri,  SCBRD-RTM,  (410)  671-3425  (Continued  on  page  ii) 

12a.  DISTRIBUTION /AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  is  unlimited. 

12b.  DISTRIBUTION  CODE- 

13.  ABSTRACT  (Maximum  200  words) 

Several  standard  benchmarks  were  implemented  in  order  to  study  the  real-time  performance  of  the 

Alsys.037  Ada  Compiler  for  the  Inmos  T800  Transputer.  A  limited  comparison  to  the  Transputer’s 
native  language,  Occam,  was  possible.  The  key  aspects  that  were  investigated  were  the  computa¬ 
tional  speed,  using  the  Whetstone  benchmark,  the  clock  resolution,  delay  resolution,  procedure 
call  overhead  and  general  performance.  These  were  measured  using  the  Performance  Issues 

Working  Group  (PWIG)  test  suite.  The  Whetstone  benchmark  was  implemented  on  the  T800  in  both 

Ada  and  Occam,  making  this  measurement  the  most  informative. 

14.  SUBJECT  TERMS 

Ada  Real-time  performance 

Transputer  Occam 

Benchmark 

15.  NUMBER  OF  PAGES 

16 

16.  PRICE  COOE 

17.  SECURITY  CLASSIFICATION 

OF  REPORT 

UNCLASSIFIED 

18.  SECURITY  CLASSIFICATION 

OF  THIS  PAGE 

UNCLASSIFIED 

19.  SECURITY  CLASSIFICATION 

OF  ABSTRACT 

UNCLASSIFIED 

20.  LIMITATION  OF  ABSTRACT 

UL 

NSN  7540  01-280  S500  Standard  form  298  (Rev  2  89) 


hv  an^i  Md  ;w  »$ 


ri*  mu 


11.  SUPPLEMENTARY  NOTES  (Continued) 


♦When  this  work  was  performed,  ERDEC  was  known  as  the  U.S.  Army  Chemical  Research, 
Development  and  Engineering  Center,  and  the  Contracting  Officer’s  Representative  and  the  Point  of 
Contact  were  assigned  to  the  Detection  Directorate. 


t 


u 


PREFACE 


The  work  described  in  this  report  was  authorized  under  Contract  No.  DAAL03-91-C- 
0034,  Delivery  Order  No.  251.  This  work  was  started  in  June  1992  and  completed  in  August  1992. 

This  work  was  supported  by  the  U.S.  Army  Edgewood  Research,  Development  and 
Engineering  Center  (ERDEC)*  under  the  auspices  of  the  U.S.  Army  Research  Office  Scientific 
Services  Program  administered  by  Battelle. 

The  use  of  trade  names  or  manufacturers’  names  in  this  report  does  not  constitute  an 
official  endorsement  of  any  commercial  products.  This  report  may  not  be  cited  for  purposes  of 
advertisement. 

Reproduction  of  this  document  in  whole  or  in  part  is  prohibited  except  with  permission 
of  the  Director,  U.S.  Army  Edgewood  Research,  Development  and  Engineering  Center,  ATTN: 
SCBRD-RT,  Aberdeen  Proving  Ground,  MD  21010-5423.  However,  the  Defense  Technical 
Information  Center  and  the  National  Technical  Information  Service  are  authorized  to  reproduce  the 
document  for  U.S.  Government  purposes. 
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EVALUATION  OF  ALSYS_037 
Ada  COMPILER 


INTRODUCTION 


The  Edgewood  Research,  Development  and  Engineering  Center  is  developing  a  Chemical 
Biological  Mass  Spectrometer  (CBMS)  containing  an  embedded  system  which  utilizes  the 
INMOS  T800  Transputer.  Although  there  are  several  programming  languages  available  for 
systems  development  on  the  Transputer,  one  of  the  most  widely  used  is  Occam.  Occam's 
popularity  can  be  attributed  to  the  fact  that  it  is  a  high  level  language  designed  to  express  parallel 
algorithms  and  their  implementation  on  a  network  of  processing  components.  In  addition,  the 
Transputer  may  be  considered  an  Occam  machine;  Occam  provides  the  efficiency  equivalent  to 
that  of  programming  a  conventional  computer  at  the  assembly  language  level  [INMOS  88]. 
However,  given  the  Congressional  Ada  Mandate  (Public  Law  101-511  -  Sec.  8092,  and  Public 
Law  102-172,  Sec.  8073),  Ada  has  been  designated  the  systems  development  language  of  choice 
for  Department  of  Defense  software  projects.  The  objective  of  this  project  was  to  evaluate  the 
Alsys_037  Ada  compiler  for  the  Transputer,  currently  the  only  commercially  available  Ada 
compiler  for  the  Transputer. 

The  general  approach  that  was  taken  for  this  project  was  to  run  a  series  of  software 
benchmark  tests  conforming  to  the  following: 


80x86  -  DOS  5.0  TRANSPUTER 


BENCHMARK 

Alsys  Ada 

Meridian  Ada 

Alsys  Ada 

Occam  1 

Whetstone 

X 

X 

X 

X 
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X 

X 

X 

Hartstone 

X 

X 
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figure  1  -  Test  Plan 


The  Whetstone  benchmark  program  [Cumow  76]  was  developed  to  compare 
processing  power  for  scientific  applications.  The  program  goes  beyond  measuring  pure  floating 
point  performance  ('flops')  by  including  features  found  in  'typical'  scientific  applications  such  as: 
conditional  jumps,  array  indexing,  integer  arithmetic,  procedure  calls,  and  evaluation  of 
elementary  functions.  The  PIWG  test  suite  [Pollack  90,  Roy  90]  contains  a  series  of  experiments 
that  assist  in  the  evaluation  of  processor  performance,  clock  resolution  and  compilation 
efficiency.  Hartstone  [Weiderman  89]  is  a  benchmarking  tool  for  evaluating  hard  real-time 
performance. 

The  initial  plan  was  to  test  these  software  benchmark  systems  across  the  Intel  80x86  and 
INMOS  T800  platforms  using  the  Alsys  Ada  compiler  for  32-bit  DOS,  the  Alsys  Ada  compiler 
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for  the  Transputer,  and  the  Meridian  Ada  compiler  for  32-bit  DOS.  The  quantitative  results  from 
these  tests  would  then  be  used  as  the  basis  for  conclusions  and  recommendations. 

TECHNICAL  DISCUSSION 


HARDWARE/SOFTWARE 

The  hardware  system  which  was  used  to  develop  and  test  the  benchmarks  consisted  of: 

Host  system  -  Gateway  2000:  80486DX/33MHz,  EISA,  8MB  RAM 
Transputer  -  CSA  Transputer  board  for  PC:  T800/20MHz,  4MB  RAM 

Once  the  DOS  executables  were  generated,  timings  were  measured  on  the  386/20MH z, 
386/33MHz,  and  486/33MHz  systems.  The  386  systems  were  equipped  with  80387  math 
coprocessors. 

The  systems  software  used  to  support  the  project  consisted  of: 

DOS  5.0 

Alsys  Ada  -  version  5.1  -  32  bit  DOS  compiler 
Alsys  Ada_037  -  version  5.4.2  -  Transputer  compiler 
Meridian  Ada  -  version  4.1.1  -  32  bit  DOS  compiler 
INMOS  Occam  Toolset  -  version  D7205 

Early  in  the  project,  the  Meridian  compiler  was  abandoned  due  to  the  volume  of  compile-time 
and  run-time  errors  encountered  with  code  which  was  successfully  tested  in  the  Alsys 
environment.  Time  did  not  permit  debugging  and  rewriting  a  large  volume  of  code.  Therefore, 
the  revised  test  plan  matrix  conforms  to  the  following: 

Alsys  Ada  -  32  bit  DOS  Transputer 


figure  2  -  Test  Plan  -  revised 
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ACTIVITIES 


WHETSTONE:  The  Whetstone  benchmark  has  been  considered  somewhat  a  standard 
benchmark  Jor  a  number  of  years.  Unlike  the  Drystone  benchmark,  Whetstone  is  intended  to 
simutr* .  typical'  scientific  applications  through  its  utilization  of  a  variety  of  routines.  It  does, 
however,  fall  short  in  several  categories  of  contemporary  scientific  calculations.  In  particular, 
it  uses  small  arrays,  no  multi-dimensional  arrays  are  employed,  it  is  dependent  on  the  speed  of 
floating  point  operations,  and  the  number  of  elementary  function  evaluations  is  probably  atypical 
of  current  programming  models  [INMOS  91,  p259].  Despite  these  observations,  it  still  provides 
a  legitimate  baseline  for  the  evaluation  required  in  this  project.  Whetstone  was  successfully 
coded  and  tested  in  both  Ada  and  Occam,  and  run  on  the  80x86  and  T800  platforms. 

PIWG:  The  Performance  Issues  Working  Group  (PIWG)  of  the  Association  for 
Computing  Machinery  (ACM)  has  made  available  a  series  of  Ada  benchmarks  which  can  be  used 
in  the  evaluation  of  Ada  compilers  across  a  rangr  of  hardware  platforms.  The  test  suite  assists 
in  the  evaluation  of  execution  time  and  compilation  time.  It  was  determined  for  this  project  that 
the  compilation  time  tests  were  of  little  value  at  this  stage  in  the  project;  therefore,  emphasis  was 
placed  on  the  evaluation  of  execution  timings.  In  particular,  there  are  four  test  areas  that  made 
up  the  critical  area  of  performance  testing.  They  are: 

1.  Clock  Resolution  (A000090)  This  test  illustrates  CPU  clock  resolution 

available  to  Ada. 

2.  DELAY  Resolution  (Y000001)  Measures  the  resolution  of  the  DELAY 

feature  of  Ada. 

3.  Procedure  Call  Overhead  (P000005/6/7)  Measures  procedure  call  overhead 

time  in  Ada. 

4.  Hennesy  Tests  (A000094A-K)  Series  of  tests  which  measure  performance 

in  a  variety  of  areas  including:  recursion, 
integer  and  real  matrix  multiplication,  and 
sorting  (data  movement). 

These  tests  were  successfully  performed  in  Ada  on  both  the  80x86  and  T800  platforms. 

HARTSTONE:  The  Hartstone  benchmark  is  a  set  of  timing  requirements  for  testing  a 
system's  ability  to  handle  hard  real-time  applications  [Wciderman  89].  The  complete  Hartstone 
benchmark  consists  of  five  categories  of  tests:  PH  Series,  PN  Series,  AH  Series,  SH  Series,  and 
SA  Series  [Weiderman  89,  p5].  The  only  test  successfully  implemented  in  Ada  to  date  is  the  PH 
Series.  This  test  provides  feedback  for  a  set  of  tasks  which  are  periodic  and  harmonic. 

The  PH  Series  was  successfully  tested  on  the  T800  platform  in  Ada;  however,  the  80x86 
DOS  tests  failed  to  provide  reliable  results.  Best  estimation  is  that  as  the  period  in  milliseconds 
began  to  approach  the  clock  resolution  available  through  the  Ada/DOS  environment,  the  system 
would  "hang";  apparently  attributable  to  DOS.  Therefore,  the  quality  of  comparable  80x86/T800 
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results  was  compromised.  Because  of  deadline  constraints,  it  was  determined  that  the  Hartstone 
benchmarks  could  not  be  successfully  implemented  and  therefore  omitted  from  this  report. 

PROCEDURES 


All  benchmark  development,  testing  and  implementation  was  performed  on  the  hardware 
and  software  mentioned  on  page  two.  Once  the  executables  were  generated,  testing  was 
conducted  according  to  figure  2  (page  two;.  All  compilations  and  binding/linking  optimization 
options  are  contained  in  APPENDIX  A. 

RESULTS 


During  this  study,  particular  attention  was  paid  to  the  clock  resolution.  The  CBMS 
system  requires  3  microsecond  resolution,  which  is  one  reason  the  T800  was  selected,  since  it 
is  capable  of  1  microsecond  resolution. 

Test  results  are  contained  in  the  charts  on  the  following  three  pages.  A  key  point  worth 
noting  is  that  the  Ada/Transputer  environment  is,  in  effect,  a  run-time  environment.  That  is,  the 
execution  of  the  Ada  generated  code  is  supervised  by  the  ISERVER.  This  run-time 
environment  does  not  permit  the  Ada  code  access  to  the  high  priority  one  microsecond  clock 
resolution  available  on  the  T800.  The  Occam  environment,  however,  does  permit  Occam  code 
one  microsecond  access.  Therefore,  perhaps  one  of  the  most  interesting  charts  is  the 
WHETSTONE  comparison.  The  other  charts,  however,  do  provide  valuable  information  on  the 
comparison  of  Ada  executable  on  20MHz  and  33MHz  processors  utilizing  different  architectures. 


CONCLUSIONS 

Real-time  systems  that  involve  events  which  occur  with  near  megahertz  frequencies 
require  one  microprocessor  feature  that  is  not  supported  by  the  80x86  line  of  processors: 
microsecond  resolution.  This  study  concludes  that  the  current  Ada  environments  available  fall 
short  of  providing  this  feature  on  the  T800,  even  though  it  can  be  suppcrteH  via  Occam. 

A  variety  of  options  exist  in  the  pursuit  of  a  solution  to  this  problem.  Perhaps  the  most 
interesting  would  be  that  of  developing  a  software  support  system  using  both  Ada  and  Occam. 
This  option  may  satisfy  both  the  timing  constraints  of  fast  real-time  systems  as  well  as  the 
Congressional  Ada  Mandate.  One  item  missing  in  permitting  this  recommendation  is  evidence 
of  the  realtime  timing  requirements  of  Occam.  Comparative  data,  such  as  that  provided  in  this 
report,  illustrating  Occam's  statistics  in  similar  PIWG  and  HARTSTONE  implementations  would 
be  helpful.  Such  data  could  provide  valuable  insight  as  to  whether  or  not  Occam  may  be  a  viable 
alternative  or  supplement  to  the  Ada  development  environment. 
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WHETSTONES 
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CLOCK  RESOLUTION  (A000090) 

Alsys  Ada 


System 


Time  (seconds) 


Transputer  (T800-2Q/20MHz) 
30386/20MHZ  (DOS) 
80386/33MHZ  (DOS) 
80486/33MHZ  (DOS) 
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DELAY  RESOLUTION  (Y000001) 
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PROCEDURE  CALL  OVERHEAD 
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1989 
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APPENDIX  A 


OPTIMIZATION 


All  code  was  compiled  and  linked  taking  advantage  of  optimization  features  provided  by  each 
specific  development  environment. 

Ada  -  DOS 

Compiler  -  Alsys  Ada  for  32-bit  DOS  -  version  5.1 


Compile  options  -  IMPROVER  CALLS  =  INLINED 

REDUCTION  =  EXTENSIVE 
EXPRESSIONS  =  EXTENSIVE  ) 

CALLS  ■  INLINED:  Call  will  be  inlined  for  subprograms  that  aren't  directly 

or  indirectly  recursive  in  response  to  INLINE  pragma. 

REDUCTION  =  EXTENSIVE:  Performs  analysis  of  intermediate  program 

representation  to  eliminate  numerous  run-time 
checks  and  removal  of  dead  code. 


EXPRESSIONS  *  EXTENSIVE:  Performs  common  subexpression  elimination 

and  additional  register  optimization. 


Bind  options  -  TIMER  =  FAST 

TIMER  *  FAST: 


High  resolution  timer  used  for  the 
implementation  of  the  DELAY  statement. 


Ada  -  Transputer 


Compiler  -  Alsys  Ada  for  the  Transputer  -  version  5.4.2 

Compile  options  -  IMPROVE=(  INLINE  =  PRAGMA 

REDUCTION  =  EXTENSIVE 
EXPRESSIONS  =  EXTENSIVE  ) 

INLINE  -  PRAGMA:  Same  as  CALLS  =  INLINED  above. 

REDUCTION  =  EXTENSIVE:  Same  as  REDUCTION  =  EXTENSIVE  above. 

EXPRESSIONS  -  EXTENSIVE:  Same  as  EXPRESSIONS  =  EXTENSIVE 

above. 


Bind  options  -  FAST_MAIN  =  YES,  FAST_TASK  =  YES 
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FAST  MAIN  =  YES: 


Attempt  to  allocate  the  primary  stack  of  the  main 
program  in  a  low-addressed  area  which  could  be 
mapped  to  the  internal  on-chip  memory  of  the 
Transputer. 

FAST_TASK  =  YES:  Attempt  to  allocate  the  primary  stack  of  the  task  in  a 

low-addressed  area  which  could  be  mapped  to  the 
internal  on-chip  memory  of  the  Transputer. 

INMOS  Occam  Toolset  -  version  D7205 
/a  /t8  /h 

Prevents  compiler  from  performing  alias  checking,  and 
prevents  usage  checking. 

Compile  for  T800  processor. 

Produces  code  in  HALT  mode. 

Linker  options  -  /t8  /h 

/t8: 

/h: 

Code  Collector  options:  /t 

It:  Creates  a  bootable  file  for  a  single  transputer. 

Host  file  server:  /se 

/se:  Terminates  the  server  if  the  Transputer  error  flag  is  set. 


Specifies  T800  as  target  processor. 
Generates  a  linked  unit  in  HALT  mode. 
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